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Abstract 

The gist of the quiekest ehange-point deteetion problem is to deteet the presenee of a ehange in the sta- 
tistieal behavior of a series of sequentially made observations, and do so in an optimal deteetion-speed- 
vs.-“false-positive”-risk manner. When optimality is understood either in the generalized Bayesian 
sense or as defined in Shiryaev’s multi-eyelie setup, the so-ealled Shiryaev-Roberts (SR) detection 
procedure is known to be the “best one can do”, provided, however, that the observations’ pre- and 
post-change distributions are both fully specified. We consider a more realistic setup, viz. one where the 
post-change distribution is assumed known only up to a parameter, so that the latter may be “misspec- 
ified”. The question of interest is the sensitivity (or robustness) of the otherwise “best” SR procedure 
with respect to a possible misspecification of the post-change distribution parameter. To answer this 
question, we provide a case study where, in a specific Gaussian scenario, we allow the SR procedure 
to be “out of tune” in the way of the post-change distribution parameter, and numerically assess the 
effect of the “mistuning” on Shiryaev’s (multi-cyclic) Stationary Average Detection Delay delivered 
by the SR procedure. The comprehensive quantitative robustness characterization of the SR procedure 
obtained in the study can be used to develop the respective theory as well as to provide a rational for 
practical design of the SR procedure. The overall qualitative conclusion of the study is an expected 
one: the SR procedure is less (more) robust for less (more) contrast changes and for lower (higher) 
levels of the false alarm risk. 
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1. Introduction 


Sequential (quickest) change-point detection is concerned with the development and evaluation of 
statistical procedures for rapid and reliable “on-the-go” detection of unanticipated changes that may 
occur in the characteristics of a “live” process. Specifically, the process is assumed to be continuously 
monitored through sequentially made observations (e.g., measurements), and should at any point in 
time their behavior start to appear as though the process may have (been) statistically changed, the aim 
is to conclude so within the smallest number of observations possible, subject to a tolerable level of the 
false positive risk. As soon as such a conclusion is reached, an “alarm” is flagged, and an appropriate 
response action is taken (e.g., an investigation is initiated as to the possible cause of the alar m). For a 
thorough treatment of the subjec t ’s theory as well as for exarnples o f applications, see, e.g.. IShirvaev 
( 1978 ). Basseville and Nikiforov ( 1993 ). Poor and Hadjiliadis ( 2009h . Veeravalli and Banerjem2013 ). 
or (ITartakovskv et al.l. 120141 Parts II and III), and the references therein. 

A sequential change-point detection procedure is identified with a stopping time, T, that is func¬ 
tionally dependent on the observations, {Xn}n^i', the semantics of T is that it constitutes a rule 
whereby one is to stop and declare that the statistical profile of the process under surveillance may have 
(been) changed. A “good” (i.e., optimal or nearly optimal) detection procedure is one that minimizes 
(or nearly minimizes) the desired detection delay penalty, su bject to a constraint on the fals e alarm 
risk. For an overview of the rnajor op t imality criteria, see, e.g. , Tartakoyskv and Moustakid^ (^10 1. 
[Polunchenko and Tartak ovskyi |201 
«Tartakovsky et al.D2014 . Part II). 

The basic quickest change-point detection problem assumes(a) that the observations, 
are independent throughout the entire period of surveillance; (b) that the observations’ common pre¬ 
change probability density function (pdf) f{x) is completely known; and (c) that so is the observations’ 
common post-change pdf g{x) ^ f{x). This version of the problem is well-understood and has been 
solved (either exactly or asymptotically) under a variety of cri t eria. For a survey of the correspondin g 
state-of-the-art, see, e.g ., Tart^ovskv and Moustakides ( 2010h . Polunchenko and Tart^ovskv ( 2012 1. 




Veeravalli and Banerjeel (1201311 . [Polunchenko et al.l (12013h . or 


Veeravalli and Banerjeel (1201311 . [Polunchenko et al.l (1201311 . or (ITartakovsky et al.L I20l4 Part II). 


This work’s focus is on a more realistic setup, namely, one where the observations’ post-change 
pdf, g{x), is assumed known only up to a parameter; assumptions (lU) and (|^ above are retained. While 
being a more practical assumption, limited (parametric) knowledge of g{x) makes the problem more 
difficult. In particular, the uncertainty in the post-change distribution parameter opens the door for a 
possible misspecification thereof. Consequently, when this parameter is set incorrectly (for whatever 
reason), the performance of any otherwise optimal detection procedure will naturally degrade. The aim 
of this work is to quantify the severity of this performance degradation as a function of the magnitude 
of the post-change distribution parameter misspecification and under various levels of the false alarm 
risk. To make it more clear, our intent in this paper is not to propose a way to deal with the parametric 
uncertainty in the post-change distribution, but merely to provide a quantitative nonasymptotic answer 
to the practically important question of robustness (or sensitivity) of a given detection procedure with 
respect to possible errors in the value of the post-change distribution parameter. 

More concretely, our goal is to examine the robustness question specifically for the so-called 
Shiryaev-Ro berts (SR) procedure, p roposed ( follow ing quasi-Bayesian considerations) by IShiryaev 
( 1961 . 1963 ) and (independently) by RobertsI ( 19661) . The term “Shiryaev-Roberts” appears to have 
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been “ coined” by iPollakl (Il985h . For a brief account of the SR procedure’s history, see, e.g.. [Poliak 
( 2009t) . The interest i n the SR pro cedure is due to two reasons. First, the SR procedure is exactly 
optimal in Shiryaev’s ( 196 ll: 1963 ) multi-cyclic sense. Second, since Shiryaev’s multi-cyclic version 
of the change-point detection problem is equivalent to the latter’s generalized Bayesian setup, the SR 
procedur e is exactly optimal in the generalized Bayesian sense as well. These results were first ob- 
tain ed bvIShirvaevI (1 196 ill 19631) for a (continuous-ti me) Brownian motion drift-shift scenario; see also, 
e.g., Shiryaev ( 2002 ); [F_einberg and Shirvaev ( 2006 ). For th e discre te-time case, these resul t s were re¬ 
cently established by Poliak and Tartakovsky ( 2008 . 2009) and by Shiryaev and ZryumovI ( 2010l) . It 
is noteworthy t hat neither the celebrated Cumulative Sum (CUSUM) “inspection scheme” proposed 
by Paed (119541) no r the popular Exponentially Weighted Moving Average (EWMA) chart introduced 
by iRobertsI (119591) possesses such strong optimality properties. For comparative perf ormance analy ¬ 
ses of the SR procedur e against the CUSUM scheme and the EWMA chart, see, e.g.. iKnothl (l2006l). 


Mahmoud et al. ( 2008 ). Moustakides et al.l ( 20091) . Tartakovsky et al.l (2009), and Polunchenko et al. 


(120151) . However, albeit strong, these optimality properties of the SR procedure hinge on the assump¬ 
tion of complete knowledge of the observations’ pre- and post-change distributions, whose pdf’s we 
agreed to denote by f{x) and by g{x), respectively. When the latter involves a parameter that the SR 
procedure has an incorrect value for, the performance of the SR procedure will no longer be “best” (op¬ 
timal). Eurthermore, the larger the error in the parameter value, the bigger the respective performance 
loss. It is to study this “cause-and-effect” relationship quantitatively that is the objective of this work, 
and the focus is entirely on the SR procedure. 

Specifically, we offer a case study where, in a particular Gaussian scenario, we intentionally set up 
the SR procedure so that it “anticipates” the observations’ pdf to change from f{x) pre-change to g{x; 9) 
post-change, while the actual change is from f{x) pre-change to g{x; 9) post-change, where 9^9, and 
then assess the effect of the “mistuning” on the procedure’s performance. The performance character 
isticsof interest are the u sual minim ax Average Run Length (ARE) to false alarm proposed by iLorden 
( 197 ih (although see also Page 1954 ) and Shiryaev’s ( 1961 : 1963 ) multi-cyclic Stationary Average De¬ 
tection Delay (STADD). We compute both metrics numerically, with the aid of an integral-eq nations 


based numer ical method that is a hybrid between one proposed and use d earlier by iMoustakides et al. 


^200911201 ih and a recent refinement thereof offered and stress-tested bv IPolunchenko et al.l (l2014byal) . 
The latter method was designed specifically for the SR procedure, and is more accurate when it comes 
to evaluation of the ARE to false alarm. The former method is used to compute the STADD, and even 
though it was originally designed only for the case when 9 = 9, it extends trivially to the case when 
9 9. The study provides an exhaustive quantitative characterization of the SR procedure’s robustness. 

Qualitatively, the overall conclusion of the study is essentially what one would expect it to be: the less 
(more) contrast the change and the higher (lower) the level of the ARE to false alarm, the less (more) 
robust the SR procedure devised to detect it. To the best of our knowledge, when the observations 
are drawn at discrete points in time, no such study has previously been undertaken, even though its 
sign ificance for applications is ap pare nt. However, for simlar st udies in the continuous-time case, see, 
e.g., Poliak and Siegmund ( 1985h and Srivastava and Wul ( 1993h . 

The rest of the paper is organized as follows. Eirstly, in Section [2] we formally state the problem, 
describe the SR procedure, briefly review its properties, and comment on how we intend to evaluate its 
performance. The case study itself is carried out next, in Section [3l which is the core section of the 
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paper. Lastly, in Section |4] we draw conclusions. 

2. The problem and preliminary background 

Since the version of the quickest change-point detection problem that is considered in this work 
is a build-up to the problem’s basic “minimax’ish” setup, it is convenient to briefly describe the latter 
first, i.e., start with the standard assumption of complete knowledge of the observations’ pre- and post¬ 
change distributions. Let the pdf’s of these distributions be f{x) and g{x), respectively; g{x) ^ fix). 
Define the change-point, 0 ^ ^ oo, as the unknown (but not random) serial index of the final pre¬ 

change observation; note that it can potentially be infinite. That is, as illustrated in Figure [H the pdf of 
Xn is fix) for 1 ^ n ^ z/, and gix) for n ^ u + 1. The notation z/ = 0 is to be understood as the case 


{^n}n>i independent throughout 


r 


A. 




Xi X2 X3 X^-1 X^+i X ^+2 X^+3 Xn 



Figure 1: Basic “minimax-ish” setup of the quickest change-point detection problem. 


when the pdf of is gix) for all n ^ 1, i.e., the distributional pattern of the data, {Xnjn^i, is affected 
by change ab initio. Similarly, the notation z/ = 00 is to mean that the pdf of X^ is fix) for all n ^ 1, 
i.e., the distributional pattern of the data, {X^jn^i, never changes. 

Let Pfc (Efc) be the probability measure (expectation) given that the change-point u is at time mo¬ 
ment (epoch) k, i.e., u = k, where 0 ^ A; ^ 00 . Particularly, Poo (Eoo) is the probability measure 
(expectation) when the observations always come from the pdf fix), i.e., u = 00 so that there is never 
a change. Likewise, Pq (Eq) is the probability measure (expectation) when the observations’ distribu¬ 
tion is gix) from the start (i.e., z/ = 0 ). 

From now on T will denote the stopping time associated with a generic detection procedure. 

Given this “minimax-ish” context, th e standard way to gauge the false alarm risk is through Lor- 


den’s (Il97lh ARL to false alarm (see also IPagdl 195411 . The ARL to false alarm is defined as ARL(T) = 
Eoo[T] and captures the average number of observations the procedure (given by stopping time T) sam¬ 
ples under the pre-change regime before stopping (i.e., before triggering a false alarm). The reciprocal 
of ARL(T) can be interpreted (roughly) as the frequency of false alarms. Hence, the false alarm risk 
turns out to be inversely proportional to ARL(T): the higher (lower) the latter, the lower (higher) the 
former. 

To introduce the multi-cyclic change-point detection problem, let 


A( 7 ) = \ T: ARL(T) ^ 7 L where 7 > 1, 
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denote the class of procedures (stopping times), T, whose the ARL to false alarm is at least 7 > 1, a 
pre-selected tolerance level. Suppose now that it is of utmost importance to detect the change as quickly 
as possible, even at the expense of raising many false alarms (using a repeated application of the same 
procedure) before the change occurs. Put otherwise, in exchange for the assurance that the change will 
be detected with maximal speed, one agrees to go through a “flurry” of false alarms along the way (the 
false alarms are ensued from repeatedly applying the same procedure, starting from scratch after each 
false alarm). This scenario is shown in Figure [2l 



(a) An example of the behavior of a process of interest with a change in mean at time v. 



Rtin Length, to False Alarm, Ti 
(random) 


(b) Typical behavior of the detection statistic in the multi-cyclic mode. 
Figure 2: Multi-cyclic change-point detection in a stationary regime. 


Formally, let Ti, T 2 ,... be sequential independent repetitions of the same stopping time, T, and let 
Tj = Ti + T 2 + ■ ■ ■ + Tj, j ^ 1, be the time of the j-th alarm. Define A — min{j ^ 1: Tj > z/} so 
that Ti^ is the time of detection of a true change that occurs at time moment u after A — 1 false alarms 
had been raised. One can then view the difference Tj^ — 0) as the detection delay. Let 

STADD(T) = lim - v] 

U^OO 


be the limiting value of the Av erage Detection Delay (ADD) referred to as the Stationary ADD (STADD); 
this metric was introduced bv lShiryaevl(ll96lLll963h . The multi-cyclic change-point detection problem 
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then is: 


to find Topt = arginf STADD(T) for any given 7 > 1; 

TeA{7) 


( 1 ) 


cf. lShiryaevl(ll96lLll963h . 

We note that, in this setup, ARL(T) is exactly the average distance between successive false alarms. 
Therefore, 1/ ARL(T) can be thought as the frequency of false alarms. Since higher (lower) frequency 
of false alarms clearly corresponds to higher (lower) false alarm risk, lower (higher) levels of ARL(T) 
correspond to higher (lower) levels of the false alarm risk. 

As can be gathered from the description, the “intrinsic assumption” of the multi-cyclic change- 
point detection problem is that the process under surveillance is not expected to be affected by change 
“for a while”, i.e., the change-point, z/, is large. Sce narios where this is a re as onable assumption 
may be encountered, e.g., in cybersecurity (see, e.g., Polunchenko et al. 2012 o r iTartakovskv et ah 


2013) and in the economic design of quality co ntrol charts (see, e.g., Duncan 1956 : Montgomervll 198d: 
Lorenzen and Vancell 19861: iHo and Caselll994t) . 


The mult i-cyclic change-point detection problem ([T]) has been solved by IPollak and Tartakovsky 
( 2008 , 20091) and by Shiryaev and Zrvumqv ( 2010) w ho s howed that the solution is the Shiryaev- 
Roberts (SR) procedure, due to Shirvaev (1961, 1963b and RobertsI ( 1966b . We reiterate that neither 
the CUSUM scheme nor the EWMA chart possesses suc h a strong optimality prop e rty. As a matter of 


fact, th e comparative performance analyses carried out by Moustakides et al.l ( 2009 ): [l^akovsky et al. 


(l2009b : [Polunchenko et al.l (12015h confirmed experimentally that both the CUSUM scheme and the 
EWMA chart are inferior to (i.e., are outperformed by) the SR procedure in the mult i-cy clic sense. Eor 
simily analyses carried out in continuous time, see, e.g.. Poliak and Siegmund ( 1985b and Srivastava and Wu 
1 1993b . 

To introduce the SR procedure, let us first point out that, by and large, in all of statistics, there 
are two principally different ways to extract information from data to make inference. One of these 
approaches is based on maximization of a certain functional of the data. The other approach is based 
on aggregation of information in a sum-like manner. This is illustrated in Pigure[3l 



Eigure 3: Two principally different approaches to statistical inference. 


In change-point detection, the first approach is manifested in the CUSUM scheme, which uses the 
maximum-likelihood principle to “sense” whether the process under surveillance has gone “out-of- 
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control”. The EWMA chart is an example of a detection procedure whose decision statistic is based on 
aggregation of information in a Bayesian-like manner. The SR procedure is also of the latter type. It is 
formally defined as the stopping time 

Sa = inf ^ 1 : ^ A}, such that inf{ 0 } = oo, ( 2 ) 

where A > 0 is a detection threshold (control limit) used to control the level of the ARL to false alarm, 
and 


n n 


(3) 


k=li=k 


is the SR detection statistic; here and onward Aj = g{Xi)/ f{Xi) denotes the “instantaneous” likelihood 
ratio (LR) for the Ath data point Xj. Note the recursion 


R 


' 71+1 


= (1 + Rn) A„+i for n = 0 , 1 ,... with Rq = 0 . 


(4) 


An important property of the SR statistic {Rn}n^o is that the sequence {Rn — n}n^o is a zero- 
mean Poo-martingale, i.e., Eo p[i?„ — n] = 0 for any n ^ 0. From this and Doob’s optional stopping 
(s ampling) theorem (see, e .g., Shirvaevlll995 . Chapter VII, Poor and Hadjiliadisll2009L Subsection 2.3.2 
or iTartakovsky et al.ll20I4i Theorem 2.3.1, p. 31), one can conclude that Eoo[i? 5 ^ — 5^] = 0 so that 
ARL(iSa) = Eoo[>Sa] = Eoo[. R.»;J > A. Hence, for an y given 7 > 1 , if A ^ 7 , then ARL(iSa) ^ 7 
and Sa G ^( 7 ). As argued by Kenett and Poliak ( 1996h . such a simple relation between ARL(iSyi) and 
A endows the SR procedure with certain data-analytic advantages over the CUSUM scheme and the 
EWMA chart. Furthermore, note that all this is valid irrespective of the particular f (x) and qfx). 

A more accurate connection between ARL(iSa) and A has been established by IPollakI (119871) who 
showed that ARL(iSa) = (A/(C)[l-|-o(l)] as A ^ 00 , i.e., ARL(iSa) ~ A/C for sufficiently large A. To 
define (, let Sn = log Aj, n ^ 1, and let = inf{n ^ 1 : Sn ^ a}, a > 0 (again, with the under¬ 
standing that inf{ 0 } = cx)). Then = Sr^—a (^ 0) is the so-called “overshoot” (excess over the level 
a > 0 at stopping), and ^ = linia^oo lEo[e“''“], and is referred to as the “limiting average exponential 
overshoot”. In general, Q is between 0 and 1, and the eva luation of th i s mod el -dependent constant falls 
withi n the scope of no nlinear renewal theory; see, e.g., Woodroofe ( 1982h . ( Veeravalli and Banerjee . 
2013 . Section II.C) or ( Tartakovsky et ah . 2014 . Section 2.6). 


More irn portantly, as was mentioned earlier, according to the result of IPollak and Tartakovsky 
( 20081 20091) and also to that of Shiryaev and Zryumovl ( 20lQi . the SR procedure is exactly STADD(T)- 


optimal. That is, formally: STADD(iSa.^) = infTGA{7) STADD(T) for every 7 > 1, where A..,, > 0 
is the solution of the equation ARL(iSa.^) = 7 > 1. However, and we mentioned that already as well, 
this result ceases to hold when the SR statistic is “out of tune” in the way of either /(x) or g{x). We 
are interested in the case when g{x) is given parametrically as g{x; 9), and the value of 9 that is used 
by the SR statistic is 9 ^9 9. To reflect that in this case STADD(iSa..,) is a function of both 9 and 9, we 
will use the notation STADDg ^(5^.^). Then clearly STADDg ^(5^.^) ^ STADDe^0(iSA.^) for all 9^9. 
The aim of this work is to assess the sensitivity of STADD^ ^(iSa.^) with respect to the magnitude of 
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the difference between 9 and 9 and under various levels of the ARL to false alarm ARL(iSa^ ) = 7 > 1 . 

It is also noteworthy that the SR procedure ©-(HI) is optimal in the generalized Bayesian sense 
as well. Specifically, the generalized Bayesian change-point detection problem is: to find Topt = 
arg inf-jng^^..^) RIADD(T) for any given 7 > 1, where RIADD(T) is the Relative Integral ADD defined 
as 


RIADD(r) 4 ^-^^E„|max{0,r- !/}], 


(5) 


This version of the quickest change-point detection problem is a limiting case of the classical 
Bayesian change-point detection problem considered and solved by Shiryaev ( 1961 . 1963b . Specifi¬ 
cally, the limit is with respect to the prior distribution of the change-point, v, which is assumed to be 
improper uniform, so that each time instance becomes equally likely to be the change-point. 

The exact generalized Bayesian optimality the SR procedure can be formally stated as follows: 
RIADD(iSa.^) = infrGA( 7 ) RIADD(r) for every 7 > 1, wh ere > 0 is again the solu t ion of 
the equation ARL(>S 4 .^/) = ^ > 1- This result is also due to Poliak and Tartakovskyl ( 20081 2009b 
and Shiryaev and Zrvumovl ( 2010b . and the proof is based on first showing that the generalized Bayesian 
version of the quickest change-point detection problem and its multi-cyclic setup © are equivalent in 
the sense that RIADD(T) = STADD(T) for any stopping time T, and then exploiting the fact that the 
SR procedure is exactly STADD(T) -optimal. 


The fact that RIADD(T) = STADD(T) for any stopping time T was used by iMoustakides et al. 


( 201lb to develop a numerical method to compute STADD(iSa), i.e., the STADD delivered by the SR 
procedure ©-@. Specifically, they observed that when T is based off of a Markovian detection statis¬ 
tic (note that the SR statistic {R„} is Markovia n), the infinite sum appear ing in the right-hand side of ® 
is a convergent geometric series. This allowed IMoustakides et al.l (1201 lb to derive an integral (renewal) 
equation directly on the entire sum without any truncation, and th en develop a numerical me thod to 
treat the integral equation; their method was recently extended by Polunchenko et al. ( 2014ab . This 
is precisely how we intend to evaluate STADD(iSa) in our case study offered in the next section: 
S TADD ( 54 ) will be comp uted numerically as RIADD(>S 4 ) with the aid of the numerical methods 
of Moustakides et al. ( 2011 ) and Polunchenko et al.l ( 2014ab . We note that these numerical methods do 
not require any truncation of either the infinite sum appearing in the definition of RIADD(T) or the 
limit appearing in the definition of STADD(T). This fact makes both methods more accurate. 

We would like to conclude the introduction of the SR procedure with a remark pertaining to a 
possible interpretation of the SR statistic, {RnjnSso- Part of the reason why the SR procedure—in spite 
of its simplicity and strong optimality properties—has not yet received proper attention from engineers 
and applied scientists (in particular, from the quality control community), is that the SR statistic is 
problematic to chart. Specifically, the problem is that the decision-making mechanism behind the SR 
procedure is not as clearly understood as that behind, e.g., the CUSUM scheme or the EWMA chart, 
which have de facto been the industry “workhorse” for decades now. A simple intuitive explanation 
of how the SR statistic “works”, i.e., a meaningful “engineering” interpretation of the SR statistic, 
could help bridge this gap, and, in the long run, might also help “pave the way” for the SR procedure 
into the “engineering world”. An attempt to provide one such interpretation was previously made 
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by Kenett and Poliak ( 1996h who, in view of the quasi-Bayesian nature of the SR proeedure, argued 
that the SR statistie, {Rn}n^o, may be regarded as a p-value. 

The interpretation we have in mind for the SR statistie lends the latter a finaneial flavor, and involves 
an ordinary savings aeeount and basie finaneial interest theory. Suppose first that one opens a savings 
aeeount at a bank and immediately makes a deposit of $ 1, so that at “time zero” (also referred to as 
“now” or “today”) the balanee is $ 1. If the aeeount aeerues interest at a rate of IR (deeimals) per time 
period, then it is easy to see that the balanee in the aeeount “tomorrow” (i.e., in one time period from 
“today”) will be $ 1 x (1 + IR). This is sehematieally illustrated in Figure HI 
Now suppose that the time horizon is 

Deposit: $1 Balance: $1 x (1 


longer than just “one day”, and onee the 
bank aeeount is opened, one funds it not 
with one, but with a series of periodic 
single-dollar deposits. Moreover, suppose 
also that the interest rate varies from period 
to period. This is shown in Figure [51 

Balance: $0 

Deposit: $1 Deposit: $1 Deposit: $1 

I I I 


t " 

today 


interest rate, IR 


t 

tomorrow 


MR) 

Time 


Figure 4: Finaneial analogy to interpret the SR statistie. 

Balance: $1 x 
Deposit: $1 


Time 


0 


IRi 


1 


IR2 


n — 1 


IRn 


n 


Figure 5: Finaneial analogy to interpret the SR statistie. 


Then, at time n before the n-th deposit 
is made, the balanee will be 


= $ 1 X ^ ]^(1 + IRj), n ^ 1, 

i=l j=i 

and we hasten to note the similarity between this formula and that for the SR statistie dH): the two 
formulae are identieal if the LR at the n-th epoeh, A„, is regarded as the n-th period interest faetor, 
i.e., the quantity (1 -f IR„). This suggests that the SR statistie, {Rn}n^o^ can be thought of the balanee 
in one’s savings aeeount at epoeh n ^ 1, assuming that the aeeount is(a) funded through a series 
of periodie one-dollar deposits, and (b) eredited (eompound) interest every period. If the deteetion 
threshold, A > 0, is interpreted as a “target balanee”, then the SR stopping time 5^ is the amount of 
time one is to wait before the aeeount aeeumulates the target balanee. Clearly, the higher the interest 
rate, the shorter the wait. This ean now be used to explain how the SR statistie makes its deeision as to 
the presenee of a ehange in the observed proeess. 

On the one hand, sinee Eoo [A„] = 1 for all n ^ 1, this is equivalent to saying that IR^ is (on average) 
zero, and, therefore, if there is no ehange, then there is no interest, and the value of money does not 
ehange over time, so the balanee in the aeeount after n single-dollar deposits is simply the eombined 
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amount thereof, which is $ n. This is in perfect alignment with the well-known Poo-martingale property 
of the SR procedure mentioned above, i.e., that Eoo[-Rn — n] = 0 for any n ^ 0. 

On the other hand, since Eg [A„] > 1 for all n ^ 1, this is the same as to say that IR„ is (on average) 
positive, and, therefore, the account is credited (compound) interest, so that the balance grows faster. 
Hence, if there is a change, the target balance of $A > 0 is achieved sooner, resulting in a quicker 
detection of the change. 

We would like to stress that this interpretation of the SR statistic is not to say that the SR procedure 
is “better” or “worse” than, e.g., the CUSUM scheme or the EWMA chart. The point is merely to help 
the “uninitiated” to intuitively understand why it is not unreasonable to at least expect the SR approach 
to work as a change-point detection tool to begin with. With this in mind, it is also instructional to 
mention that the decision-making process behind the CUSUM scheme is drastically different from 
that behind the SR procedure. Specifically, recall first that the CUSUM chart calls for stopping at 
Ca — inf{n ^ 1: Wn ^ A}, where A > 0 is again the detection threshold (control limit) and {lUnjnSso 
is the CUSUM statistic defined as 


Wn = max{0, Wn-i + log A„} for n = 0,1,... with Wq = 0; 


cf. Page (!1954 ). Then, on the one hand, observe that because Eoo[logA„] < 0 for all n ^ 1, it 
follows that under the “no-change” regime the CUSUM statistic has a negative drift, which causes 
the CUSUM statistic to constantly “gravitate” toward zero. Since the latter is a reflective barrier for 
the CUSUM statistic, this endows the CUSUM scheme with a built-in mechanism to reset its statistic 
when, after a while of surveillance, the data have given no reason to believe their distribution changed. 
Th is internal res e tting m echanism plays a major role in CUSU M’s minimax optimality first established 
by Moustakides ( 19861) and then also proved by iRitovI (Il990h using a different approach. By contrast, 
the SR procedure does not operate in this manner, and the SR statistic has no resetting feature to it. 
On the other hand, observe that Ei,[log A„] > 0 for all n ^ 1 and 0 ^ u < n, and therefore, as soon 
as the observations are affected by change, the drift of the CUSUM statistic becomes positive, so that 
the CUSUM statistic starts to climb up toward the detection threshold, and eventually either hits it or 
surpasses it, signalling an alarm to indicate the change has (apparently) occurred. This difference in 
the way the CUSUM statistic behaves in the pre- and in the post-change regimes makes the CUSUM 
statistic very convenient to interpret when it is plotted against time: not only will the plot show that the 
change is likely to have occurred, but it will also provide a clue as to when it occurred. The SR statistic 
does not offer this kind of convenience. 

To illustrate the above point, consider Figure which gives an example of the typical behavior 
of the CUSUM statistic {Wn} and that of the SR statistic {Rn} for the problem of detecting a shift 
in the mean of a series of independent standard Gaussian observations {X„}. Specifically, Figure 1^ 
presents a sample trajectory of {Xn} of 100 points, with the change occurring at epoch u = 50, i.e., 
right down the middle of the sample, and the magnitude of the shift is 0.5. Shown underneath Figure!^ 
are Figures 1^ andwhich depict the respective trajectories of the CUSUM statistic [Wn] and of the 
SR statistic 

As can be seen, both the CUSUM statistic and the SR statistic change their behavior drastically as 
soon as the data series undergoes a change in the mean. Both statistics begin to climb up, and if there 
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(a) Observed data, {Xn}. 




(b) CUSUM statistic, {Wn}- (c) SR statistic, {Rn}- 

Figure 6: Illustration of the behavior of the CUSUM statistic and that of the SR statistic for the same 
data. 
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were a deteetion threshold (eontrol limit) imposed, one eould deelare the ehange as having oeeurred as 
soon as the respeetive statistie would reaeh or exeeed the threshold. However, as was explained above, 
at the loeal level the two statisties are poles apart: they eaeh “sense” the presenee of the ehange in a 
eompletely different manner. 


3. The case study 


As the eenterpieee of this work, this seetion is devoted to a ease study, where, in a eonerete seenario 
and subjeet to the eonstraint ARL(iSa) = 7 for a given 7 > 1, we quantify STADDg as a funetion 
of Q and 6 *, and, in partieular, assess the sensitivity of STADDgg(iSA) with respeet to the magnitude 
of the differenee d — Q. We would like to reiterate th at to eompute ARL(>S 4 ) a nd STADD^ ^(5^), we 
w ill rely on two numerieal m ethods: one proposed bv lMoustakides et al.l (1201 ih and its refinement due 


to 


Polunehenko et al. ( 2014b 2)- 


Speeifieally, suppose that the observations, {Xn}n^i, are independent and Gaussian-distributed, 
with mean zero pre-ehange and with mean 9^0 post-ehange, i.e., 9 is the aetual (true) value of the 
post-ehange mean; suppose also that the varianee is 1 and does not ehange. Formally, the pre- and 
post-ehange pdf’s in this ease are 


fix) = 




exp 


4}andj(x;«) = ^ 


exp 


[X 


9f 


respeetively, where a; G M and 6 ^ 7 ^ 0. When it is assumed that 9 has no way to be misspeeified, this 
Gaussian seenario is the standard “testbed” model widely used in the literature. We are interested in 
the ease when 9 can be misspeeified (for whatever reason), and let 9 denote the respeetive putative (or 
“antieipated”) value of 9. That is, it is 9 (and not 9) that is to be used to eonstruet the eorresponding LR 
to then base the SR statistie off of. 

For the Gaussian seenario under eonsideration, the eorresponding “instantaneous” LR for the n-th 
data point, i.e., A„ = g{Xn] 9)/f{Xn), ean be seen to be 


= exp 




n ^ 1 , 


and, therefore, for eaeh n ^ 1, the LR’s distribution is log-normal and sueh that logA„ has mean 
—6*^/2 and varianee 6 *^ under measure Poo, and mean 99 — 6*^/2 ( 7 ^ —9‘^/2) and varianee 9"^ under 
measure Po(-|6*), where Po(-|6*) denotes the probability measure under the assumption that the ehange 
is in effeet from the start and that the aetual distribution of the observations is g{x; 9). Speeifieally, let 
— IPoo(Ai ^ t),t ^ 0, and PQ{t\9,9) = Po(Ai ^ t\9), f ^ 0, be the eumulative distribution 
funetions (edf’s) of the LR in the pre- and in the post-ehange regimes, respeetively. Then, we obtain: 


P^it) 


sign ( 6 *) 


9 


logf -f 



0 , for t < 0, 


for f ^ 0 ; 
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and 


Po\t\9,9) = 


$ |^sign( 6 *) 

0 , for t < 0 , 


where 


1, 9 ^ 

- log t H- 9 

9 2 


, for t ^ 0 ; 


$(a;) = 


J-c 


e 2 (it, X G M, 


is the standard Gaussian cdf. We note that, as expected, P^{t) d oes not depend on 9. Wh h P^{t) 
an d 9) both expresse d explicitly, the numerical method of IMoustakides et alJ (1201 lib and that 

of Polunchenko et alJ ( 2014bl 3) can be implemented. We implemented the methods in MATLAB, the 
popular software package for scientific simulation and computation developed by Math Works, Inc. 
Both methods were set up so that the accuracy is on the order of a fraction of a percent. 

We are now in a position to begin our case study. To that end, the obvious point of departure is the 
question: How does one choose the detection threshold, A > 0, so as to guarantee that ARL(iS^) = 7 
for a given 7 > 1? To answer this question, recall that, as was discussed in Section [2l at least when 
A > 0 is sufficiently large, ARL(iSyi) ~ A/C, where C is the limiting average exponential overshoot. 
Thus, if C were known (at least approximately), then A ^ ('j would provide (approximately) the sought 
value of the detection threshold needed to ensure ARL(iS/i) ~ 7 for a given 7 > 1 . For our Gaussian 
scenario, C = C (9) can be computed numerically from the well-known (exact) formula: 


C = — exp 
92 




k=l 



wh ere <h(x) is the standard Gaussian cdf; see, e.g., (IWoodroofd. 119821 Example 3.1, pp. 32-33) 
or (iTartakovsky et al.L 120141 Section 3.1.5, p. 137). Since it is well known that 


2<h(-f) ^ 


t 


ttI + P 


£. 
' 2 


for all f > 0 , 


it is easy to see that the infinite series appearing under the exponent in the above formula for ( converges 
exponentially fast. Hence, to compute C accurately, it is “safe” to simply “chop off” the series at 
a reasonably distant term. We used the first 10® terms, which is substantially more than needed to 
compute C very accurately. We computed and tabulated ( for 9 = 0.1,0.2,...,1.0. The obtained 
values (rounded to the first six decimal places) are repo rted in the second leftmost column in Table [B 
These values coincide with those previously found by (IWoodroofeL 119821 p. 33). With ( known, the 
detection threshold, A = A..,,, needed to ensure ARL(iSa.^) ~ 7 for a given 7 > 1 can be determined 
zs, = Ct- However, note that the latter formula is an approximate one (it becomes exact only 
asymptotically, when A —>■ cx)), and if A^ = (/y and is definite number, then the actual proximity of 
A RL(>S 4 ) to 7 needs to be y erified. To that end, for greater certainty, we used the numerical method 
of iPolunchenko et al.l (l2014bh and computed numerically (with high accuracy) the actual level of the 
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ARL to false alarm for each value of the detection threshold. These numerically computed ARL to 
false alarm levels can be considered trustworthy. Table [Hreports the obtained results. Specifically, each 
column under the heading “Desired level of the Average Run Length (ARL) to false alarm” corresponds 
to a specific level of the ARL to false alarm 7 > 1 picked between 10 ^ and 10 ^. Each row corresponds 
to a specific value of 6 (the value of 6 in this case is irrelevant). The content of each cell is two numbers 
placed one on top of the other. The top number is the detection threshold computed as A = 7 ^ for the 
corresponding 7 and 9. The bottom number (in parenthe ses) is the actual level of th e ARL to false alarm 
(computed numerically using the numerical method of Polunchenko et al.l 2014bh that corresponds to 
that particular detection threshold. The main conclusion that can be made from the results is that the 
approximation ARL(iSyi) ~ AjC, is quite accurate, uniformly across all 9 and all 7 > 1 . 

We are now in a position to examine the sensitivity of STADD^ ^(iSyi) with respect Xo 9 — 9, i.e., 
the size of the error in the post-change mean. Specifically, in view of the fact that STADDg ^(iSyi) is 
the lowest when 9 — 9 = X), ix makes sense to use STADDe ^(iSa) as a benchmark and measure the 
performance loss via the following relative efficiency (RE) metric: 


RE 


e,e 


STADD,- ,(5a) - STADDe,,(5A) 
^ “ STADD,,,(5a) 


where it is understood that the constraint ARL(iSa) = 7 is fulfilled for a given 7 > 1. Due to the exact 
STADD-optimality of the SR procedure when 9 = 9, ix is clear that REgg(iSA) ^ 0 in general, and 
that REe ^(iSa) = 0 in particular. The actual robustness of the SR procedure would then be inversely 
proportional to REgg(iSA): smaller (higher) values of REgg(iSA) would correspond to greater (lower) 
robustness. We will consider three levels of the ARL to false alarm: 7 = 10^, which corresponds to 
high false alarm risk, 7 = 10 ^, which corresponds to moderate false alarm risk, and 7 = 10 ^, which 
corresponds to low false alarm risk. 

Let us first consider the case when ARL(iSa) = 7 = 10 ^. The values of the detection threshold for 
different values of 9 are given in Table [B Table [2] summarizes of the behavior of STADDg ^(iSa) and 
that of REg ^(iSa) each regarded as a bivariate function of 9 and 9. Specifically, the content of each cell 
in the table is a pair of numbers, one on top of the other: the top number is the actual STADD^ ^(iSa)- 
value computed for the respective pair of 9 and 9 and rounded to two decimal places, and the bottom 
number (given in parentheses) is the respective REg ^(iSa) -value given as a percentage. Eor example, 
the top number in cell positioned at the intersection of the first (topmost) row and the rightmost column 
is 9.86. This number is the value of STADDgg(iSA) when 9 = 0.1 and 9 = 1.0 (and the ARL to false 
alarm is 10^). The number underneath it is 80.68%, and it is the relative excess of the 9.86 over the ideal- 
case performance. The ideal case is when 9 = 9 = 1 . 0 , and the respective value of STADDg ^(iSa) is 
5.46 as can be inferred from the content of the cell positioned at the intersection of the bottommost row 
and the rightmost column. The 80.68 % is computed as 100 % x (9.86 — 5.46)/5.46. This explains why 
all the percentages along the table’s diagonal are zero: it is the ideal case, i.e., when 9 = 9, and in this 
case the SR procedure is exactly STADD(T)-optimal. 

As a complement to Tabled Eigure|3 provides a graphical representation of REg ^(iSa) for various 
values of 9 and 9 by means of a grayscale “heat diagram”. The idea is to represent lower (higher) 
values of REg ^(iSa) with fainter (stronger) shades of gray. Eor better perception, Eigure|7]also contains 
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Post-change mean (putative=true) 


Table 1: Characterization of the detection threshold {A > 0) for selected values of the post-change mean {6 = 6) and ARL to 
false alarm (i.e., ARL(iSa) = 7 > 1 ). 


Desired level of Average Run Length (ARL) to false alarm (i.e., ARL(iSyi) = 7 > 1) 



c 

1 X 10^ 

2 X 10^ 

3 X 10^ 

4 X 10^ 

5 X 10^ 

6 X 10^ 

7 X 10^ 

8 X 10^ 

9 X 10^ 

1 X 10^ lx 10'‘ 

0.1 

0.943408 

94.34 

(100.28) 

188.68 

(200.28) 

283.02 

(300.28) 

377.36 

(400.28) 

471.7 

(500.28) 

566.04 

(600.28) 

660.38 

(700.28) 

754.72 

(800.27) 

849.06 

(900.27) 

943.4 9,434.08 

(1,000.27) (10,000.28) 

0.2 

0.890037 

89.0 

(100.31) 

178.00 

(200.31) 

267.01 

(300.32) 

356.01 

(400.31) 

445.01 

(500.31) 

534.02 

(600.31) 

623.02 

(700.31) 

712.02 

(800.31) 

801.03 

(900.31) 

890.03 8,900.36 

(1,000.31) (10,000.3) 

0.3 

0.839721 

83.97 

(100.35) 

167.94 

(200.35) 

251.91 

(300.35) 

335.88 

(400.35) 

419.86 

(500.35) 

503.83 

(600.35) 

587.8 

(700.35) 

671.77 

(800.35) 

755.74 

(900.34) 

839.72 8,397.21 

(1,000.35) (10,000.36) 

0.4 

0.792298 

79.22 

(100.39) 

158.45 

(200.39) 

237.68 

(300.39) 

316.91 

(400.39) 

396.14 

(500.39) 

475.37 

(600.39) 

554.6 

(700.39) 

633.83 

(800.39) 

713.06 

(900.39) 

792.29 7,922.98 

(1,000.39) (10,000.4) 

0.5 

0.747615 

74.76 

(100.45) 

149.52 

(200.44) 

224.28 

(300.44) 

299.04 

(400.44) 

373.8 

(500.44) 

448.56 

(600.44) 

523.33 

(700.45) 

598.09 

(800.44) 

672.85 

(900.44) 

747.61 7,476.15 

(1,000.44) (10,000.45) 

0.6 

0.705525 

70.55 

(100.5) 

141.1 

(200.5) 

211.65 

(300.5) 

282.2 

(400.5) 

352.76 

(500.5) 

423.31 

(600.5) 

493.86 

(700.5) 

564.41 

(800.5) 

634.97 

(900.5) 

705.52 7,055.25 

(1000.5) (10,000.5) 

0.7 

0.665887 

66.58 

(100.55) 

133.17 

(200.55) 

199.76 

(300.55) 

266.35 

(400.56) 

332.94 

(500.57) 

399.53 

(600.56) 

466.12 

(700.56) 

532.7 

(800.55) 

599.29 

(900.55) 

665.88 6,658.87 

(1,000.55) (10,000.56) 

0.8 

0.628566 

62.85 

(100.62) 

125.71 

(200.62) 

188.56 

(300.61) 

251.42 

(400.62) 

314.28 

(500.62) 

377.13 

(600.61) 

439.99 

(700.62) 

502.85 

(800.62) 

565.7 

(900.61) 

628.56 6,285.66 

(1,000.62) (10,000.62) 

0.9 

0.593435 

59.34 

(100.7) 

118.68 

(200.7) 

178.03 

(300.7) 

237.37 

(400.7) 

296.71 

(500.7) 

356.06 

(600.7) 

415.4 

(700.7) 

474.74 

(800.69) 

534.09 

(900.7) 

593.43 5,934.35 

(1.000.7) (10,000.71) 

1.0 

0.56037 

56.03 

(100.77) 

112.07 

(200.78) 

168.11 

(300.79) 

224.14 

(400.77) 

280.18 

(500.78) 

336.22 

(600.78) 

392.25 

(700.77) 

448.29 

(800.78) 

504.33 

(900.78) 

560.37 5,603.7 

(1,000.79) (10,000.78) 





Table 2 : Characterization of STADD^ ^(5^) and RE^ ^(5^) as functions of the putative value (9) and of 
the true value (9) of the post-change mean for the ARE to false alarm of 10^ (i.e., ARL(iS^) = 7 = 10^). 


True value of the post-change mean ( 9 ) 



0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

0.9 

1.0 

0.1 

40.14 

29.7 

23.58 

19.57 

16.75 

14.67 

13.05 

11.77 

10.73 

9.86 

(0%) 

(5.18%) 

(14.29%) 

(24.2 %) 

(34.18%) 

(44.0%) 

(53.58%) 

(62.89%) 

(71.92%) 

(80.68 %) 

0.2 

41.93 

28.24 

21.01 

16.67 

13.81 

11.79 

10.3 

9.14 

8.23 

7.49 

(4.47%) 

(0%) 

(1.87%) 

(5.8%) 

(10.59%) 

(15.78%) 

(21.12%) 

(26.52%) 

(31.89%) 

(37.21 %) 

0.3 

44.58 

28.74 

20.63 

15.92 

12.92 

10.86 

9.36 

8.24 

7.36 

6.66 

(11.06%) 

(1.78%) 

(0%) 

(1.03%) 

(3.4%) 

(6.6 %) 

(10.17%) 

(13.99%) 

(17.93%) 

(21.93%) 

0.4 

47.1 

29.74 

20.84 

15.76 

12.57 

10.43 

8.91 

7.77 

6.9 

6.21 

(17.35%) 

(5.31 %) 

(1.05%) 

(0%) 

(0.69 %) 

(2.42%) 

(4.77%) 

(7.52%) 

(10.52%) 

(13.67%) 

0.5 

49.41 

30.93 

21.34 

15.88 

12.49 

10.24 

8.66 

7.5 

6.61 

5.92 

(23.09 %) 

(9.52%) 

(3.47%) 

(0.74%) 

(0%) 

(0.52%) 

(1.85%) 

(3.73%) 

(5.96%) 

(8.43%) 

0.6 

51.51 

32.2 

22.01 

16.17 

12.56 

10.18 

8.53 

7.34 

6.43 

5.73 

(28.32%) 

(14.05%) 

(6.7%) 

(2.58%) 

(0.58 %) 

(0%) 

(0.41 %) 

(1.49%) 

(3.03%) 

(4.9%) 

0.7 

53.43 

33.52 

22.79 

16.58 

12.74 

10.23 

8.5 

7.25 

6.32 

5.6 

(33.12%) 

(18.72%) 

(10.46%) 

(5.2%) 

(2.06 %) 

(0.47%) 

(0%) 

(0.33%) 

(1.23%) 

(2.54%) 

0.8 

55.21 

34.85 

23.64 

17.08 

13.02 

10.36 

8.53 

7.23 

6.26 

5.52 

(37.55 %) 

(23.43%) 

(14.6%) 

(8.39%) 

(4.24%) 

(1.7%) 

(0.39 %) 

(0%) 

(0.28%) 

(1.04%) 

0.9 

56.86 

36.18 

24.55 

17.66 

13.36 

10.55 

8.62 

7.25 

6.24 

5.47 

(41.65%) 

(28.13%) 

(19.01%) 

(12.04%) 

(6.98 %) 

(3.56 %) 

(1.44%) 

(0.34%) 

(0%) 

(0.23%) 

1.0 

58.39 

37.5 

25.49 

18.29 

13.76 

10.79 

8.76 

7.32 

6.26 

5.46 

(45.48 %) 

(32.79%) 

(23.59%) 

(16.05%) 

(10.19%) 

(5.94%) 

(3.05 %) 

(1.25%) 

(0.3%) 

(0%) 


contours corresponding to a few selected levels of REg 0 (iSA). For instance, the curves labeled “5%” 
provide boundaries for the values of 9 and 9 for which REgg(iSA) ^ 5%. One may note that more 
or less uniformly across the entire Table [2] (i.e., uniformly in 9 and 9), if the error in the post-change 
mean is about 0.1 0.2 in absolute value, then the respective relative performance degradation is on the 

order of a few percentage points, which would be considered “tolerable” in most practical situations. 
Figure |7] confirms this. One may also note that the sensitivity is higher when 9 and 9 are small, and then 
it gradually decreases as 9 and 9 increase. This is especially apparent in Figure|71 where the “5 %”-level 
boundaries are narrower around the origin, and get further apart as one moves away from the origin. 
We also note that when \9 — 9\ ^ 0.5, the performance loss may be hard to ignore in practice, as it is 
on the order of tens of percent. 

Let us now consider the cases when 7 = 10^ and 7 = 10^. Tables [3] and |4] and Figures [ 8 ] and |9] 
summarize the corresponding results. By and large, the results are similar to the case when 7 = 10^. 
The difference is that the STADD numbers are higher for higher levels of the ARE to false alarm. This 
makes perfect sense, because the higher the ARE to false alarm level, the lower the false alarm risk, 
and the price to pay for being more risk-averse is a higher detection delay. More importantly. Tables [3] 
and [Hand Figures [ 8 ] and |9] suggest that, as the ARL to false alarm level increases, the SR procedure 
becomes more sensitive (or less robust) to the error in the post-change parameter. This conclusion can 
be drawn from the observation that, as the ARL to false alarm level increases, so do the REg 0 (iSA) 


16 

























Putative value of the post-change mean { 6 ) 


True value of the post-change mean { 6 ) 



Figure 7: Characterization of REg ^(iSa) as a function of the putative value (9) and of the true value (9) 
of the post-change mean for the Gaussian scenario for the ARE to false alarm of 10^ (i.e., ARL(iS^) = 
7 = lOh. 
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numbers, uniformly across all 6 *’s and 6 *’s. This effect of the ARL to false alarm level on the robustness 
of the SR procedure aligns well with one’s intuition. 


Table 3: Characterization of STADDg ^(5^) and REg ^(5^) as functions of the putative value (9) and of 
the true value (9) of the post-change mean for the ARL to false alarm of 10^ (i.e., ARL(iS^) = 7 = 10^). 


True value of the post-change mean ( 9 ) 



0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

0.9 

1.0 

0.1 

193.5 

99.38 

66.23 

49.63 

39.7 

33.09 

28.38 

24.86 

22.12 

19.94 

(0%) 

(6.92 %) 

(18.96%) 

(32.0%) 

(45.13%) 

(58.05 %) 

(70.7%) 

(83.03%) 

(95.04%) 

(106.75%) 

0.2 

206.82 

92.94 

57.48 

41.31 

32.2 

26.38 

22.35 

19.4 

17.15 

15.37 

(6.88 %) 

(0%) 

(3.25%) 

(9.87%) 

(17.72%) 

(26.01 %) 

(34.44%) 

(42.84%) 

(51.17%) 

(59.37%) 

0.3 

231.28 

96.3 

55.68 

38.36 

29.12 

23.45 

19.63 

16.88 

14.82 

13.21 

(19.52%) 

(3.61 %) 

(0%) 

(2.03%) 

(6.47%) 

(11.99%) 
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4. Conclusion 


This work sought to examine what happens to the performance of the Shiryaev-Roberts (SR) proce¬ 
dure when the latter is set up to detect the “wrong” change. Specifically, considered within the context 
of the basic quickest change-point detection problem, the SR procedure was intentionally allowed to be 
“out of tune” in the way of the actual value of a parameter in the observations’ post-change distribution 
(e.g., as a result of th e latte r know n only up to that parameter), and the question was to understand how 


sensitive Shiryaev’s (1 19611 : 119631) multi-cyclic Stationary Detection Delay (STADD) delivered by the 


SR procedure is with respect to the severity of the post-change distribution parameter misspecification. 
To answer this question, we offered a case study where the robustness of the SR procedure was exam¬ 
ined numerically in a specific Gaussian scenario. The obtained exhaustive characterization of the SR 
procedure’s robustness can be used to develop the respective theory (which is still missing) and can also 
provide guidance to practitioners interested in employing the SR procedure. Qualitatively, the overall 
conclusion of the study was that the less (more) contrast the change and the lower (higher) the false 
alarm risk, the less (more) robust the SR procedure devised to detect it. This is an expected result. 
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Figure 8 : Characterization of REg ^(iSa) as a function of the putative value (9) and of the true value (9) 
of the post-change mean for the ARE to false alarm of 10^ (i.e., ARL(iS^) = 7 = 10^). 



























Table 4: Characterization of STADD^ ^(iSa) and RE^ ^(iSa) as functions of the putative value (9) and of 
the true value (9) of the post-change mean for the ARE to false alarm of 10*^ (i.e., ARL(iS^) =7 = 10^). 
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Figure 9: Characterization of REg ^(iSa) as a function of the putative value (9) and of the true value (9) 
of the post-change mean for the ARE to false alarm of 10"^ (i.e., ARL(iS^) = 7 = 10^). 
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